A Comparative Study on Apache Spark and Map Reduce with Performance Analysis Using KNN and Page Rank Algorithm

Shilpa Deshmukh; Himanshu Suhas Mone

Title:
A Comparative Study on Apache Spark and Map Reduce with Performance Analysis Using KNN and Page Rank Algorithm

Authors:
Himanshu Suhas Mone | Shilpa Deshmukh
DOI:
https://doi.org/10.31142/ijtsrd15629

Cite This Article :

Himanshu Suhas Mone | Shilpa Deshmukh "A Comparative Study on Apache Spark and Map Reduce with Performance Analysis Using KNN and Page Rank Algorithm" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-2 | Issue-4, June 2018, pp.2391-2396, URL: https://www.ijtsrd.com/papers/ijtsrd15629.pdf

Download

Abstract :
With the unremitting advancement of internet, IT and enhancement of technology, tremendous growth of data has been observed. Data is getting generated at very tremendous speed, referred to as Big Data. Big Data has gained more prominence in recent times with continuous explosion of data resulting from various sources. The major focus of this paper is to compare performance between Hadoop and Spark on iterative and machine learning algorithm. Hadoop and Spark both are processing model for analysing big data and their performance varies significantly based on the use case under implementation. In this paper, we compare these two frameworks along with providing the performance analysis using a standard machine learning algorithm for classification (knn) and Page Rank algorithm.

Keywords :
Big data, Hadoop, Map Reduce, Spark, Mahout, MLib, Machine Learning, KNN, Page Rank

Publication Details:

Unique Identification Number : IJTSRD15629

Published In : Volume-2 | Issue-4, June 2018

Page Number(s) : 2391-2396

Publisher Name : IJTSRD | www.ijtsrd.com | E-ISSN 2456-6470

Copyright © 2019 by author(s) and International Journal of Trend in Scientific Research and Development Journal. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0) (http://creativecommons.org/licenses/by/4.0)

About IJTSRD
Indexing

International Journal of Trend in Scientific Research and Development - IJTSRD having online ISSN 2456-6470. IJTSRD is a leading Open Access, Peer-Reviewed International Journal which provides rapid publication of your research articles and aims to promote the theory and practice along with knowledge sharing between researchers, developers, engineers, students, and practitioners working in and around the world in many areas like Sciences, Technology, Innovation, Engineering, Agriculture, Management and many more and it is recommended by all Universities, review articles and short communications in all subjects. IJTSRD running an International Journal who are proving quality publication of peer reviewed and refereed international journals from diverse fields that emphasizes new research, development and their applications. IJTSRD provides an online access to exchange your research work, technical notes & surveying results among professionals throughout the world in e-journals. IJTSRD is a fastest growing and dynamic professional organization. The aim of this organization is to provide access not only to world class research resources, but through its professionals aim to bring in a significant transformation in the real of open access journals and online publishing.